Search results for "Image fusion"
showing 10 items of 29 documents
Deep multimodal fusion for semantic image segmentation: A survey
2021
International audience; Recent advances in deep learning have shown excellent performance in various scene understanding tasks. However, in some complex environments or under challenging conditions, it is necessary to employ multiple modalities that provide complementary information on the same scene. A variety of studies have demonstrated that deep multimodal fusion for semantic image segmentation achieves significant performance improvement. These fusion approaches take the benefits of multiple information sources and generate an optimal joint prediction automatically. This paper describes the essential background concepts of deep multimodal fusion and the relevant applications in compute…
NIR and Visible Image Fusion for Improving Face Recognition at Long Distance
2014
Face recognition performance achieves high accuracy in close proximity. However, great challenges still exist in recognizing human face at long distance. In fact, the rapidly increasing need for long range surveillance requires a passage from close-up distances to long distances which affects strongly the human face image quality and causes degradation in recognition accuracy. To address this problem, we propose in this paper, a multispectral pixel level fusion approach to improve the performance of automatic face recognition at long distance. The main objective of the proposed approach is to formulate a method to enhance the face image quality as well as the face recognition rate. First, v…
Food Tray Sealing Fault Detection in Multi-Spectral Images Using Data Fusion and Deep Learning Techniques
2021
A correct food tray sealing is required to preserve food properties and safety for consumers. Traditional food packaging inspections are made by human operators to detect seal defects. Recent advances in the field of food inspection have been related to the use of hyperspectral imaging technology and automated vision-based inspection systems. A deep learning-based approach for food tray sealing fault detection using hyperspectral images is described. Several pixel-based image fusion methods are proposed to obtain 2D images from the 3D hyperspectral image datacube, which feeds the deep learning (DL) algorithms. Instead of considering all spectral bands in region of interest around a contamin…
Multitemporal fusion of Landsat and MERIS images
2011
Monitoring Earth dynamics from current and future observation satellites is one of the most important objectives for the remote sensing community. In this regard, the exploitation of image time series from sensors with different characteristics provides an opportunity to increase the knowledge about environmental changes, which are needed in many operational applications, such as monitoring vegetation dynamics and land cover/use changes. Many studies in the literature have proven that high spatial resolution sensors like Landsat are very useful for monitoring land cover changes. However, the cloud cover probability of many areas and the 15-days temporal resolution restrict its use to monito…
Introduction to the Issue on Advances in Remote Sensing Image Processing
2011
The papers in this special issue span a wide range of problems arising in modern remote sensing data analysis and provide a snapshot in the state-of-the-art of remote sensing image processing. More advances are expected in the near future, mainly due to the increasing user demands in terms of spatial, spectral, and temporal resolutions of data, and of products generated from these data by automatic processing techniques.
Multimodal biometric recognition systems using deep learning based on the finger vein and finger knuckle print fusion
2020
Recognition systems using multimodal biometrics attracts attention because they improve recognition efficiency and high-security level compared to the unimodal biometrics system. In this study, the authors present a secure multimodal biometrics recognition system based on the deep learning method that uses convolutional neural networks (CNNs). The authors propose two multimodal architectures using the finger knuckle print (FKP) and the finger vein (FV) biometrics with different levels of fusion: the features level fusion and scores level fusion. The features extraction for FKP and FV are performed using transfer learning CNN architectures: AlexNet, VGG16, and ResNet50. The key step aims to …
Recent advances in remote sensing image processing
2009
Remote sensing image processing is nowadays a mature research area. The techniques developed in the field allow many real-life applications with great societal value. For instance, urban monitoring, fire detection or flood prediction can have a great impact on economical and environmental issues. To attain such objectives, the remote sensing community has turned into a multidisciplinary field of science that embraces physics, signal theory, computer science, electronics, and communications. From a machine learning and signal/image processing point of view, all the applications are tackled under specific formalisms, such as classification and clustering, regression and function approximation…
Atlas selection strategy using least angle regression in multi-atlas segmentation propagation
2011
International audience; In multi-atlas based segmentation propagation, segmentations from multiple atlases are propagated to the target image and combined to produce the segmentation result. Local weighted voting (LWV) method is a classifier fusion method which combines the propagated atlases weighted by local image similarity. We demonstrate that the segmentation accuracy using LWV improves as the number of atlases increases. Under this context, we show that introducing diversity in addition to image similarity by using least-angle regression (LAR) criteria is a more efficient way to rank and select atlases. The accuracy of multi-atlas segmentation converges faster when the atlases are sel…
Automatic image enhancement by picture fusion
2005
This paper describes an automatic technique able to fuse different images of the same scene, acquired with different camera settings, in order to obtain an enhanced single representation of the interested. This allows to extend the functionalities (depth of field, dynamic range) of medium and low cost digital cameras. When Multi-Scale Decomposition (MSD) is used on differently focused images, magnification and blurring effects of lens focusing systems often compromise the final image with unpleasant artifacts. In our approach new techniques able to reduce these artifacts are introduced. Even if the algorithm has been essentially designed to extend depth of field it can be also used on multi…
Multi-resolution spatial unmixing for MERIS and Landsat image fusion
2016
Nowadays, the increasing quantity of applications using images from Earth Observation satellites makes demanding better spatial, spectral and temporal resolutions. Nevertheless, due to the technical constraint of a trade off between spatial and spectral resolutions, and between spatial resolution and coverage, high spatial resolution is related with low spectral and temporal resolutions and vice versa. Data fusion methods are a good solution to combine information from multiple sensors in order to obtain image products with better characteristics. In this paper, we propose an image fusion approach based on a multi-resolution and multi-source unmixing. The proposed methodology yields a compo…